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RESEARCH ON ACHIEVEMENT DETERMINANrS 
IN EDUCATIONAL SISTEMS : 

A SURVEY 



INTRODUCTION 

This note surveys research relevant to the specification of 
achievement models and outlines problems encountered when one looks at 
the needs of a particular part of the student population. A central 
focus of current educational concern is the capacity of educational 
systems for raising achievement levels and changing deviant behavior- 
patterns of low- income and culturally deprived students. Past research 
relevant to this question leaves educational m^el-bullders with an 
array of challenging tasks. 

Two types of studies dominate the literature in this field (l) cross- 
sectional studies using multiple correlation to estimate the degree to 
which achievement (measured typically in averages) differentials are 
attributable to differences in school program or personnel Inputs and 
(2) longitudinal studies following student participants over tiine to 
estimate input-output relations for pilot demonstration programs 
diffused across the nation. Difficulties that researchers have 
encountered in precisely specifying input-output relations in schools 
are numerous . 

For example, accounting for inter-school differences based on 
regional urban-rural, and socioeconomic factors, leaves little 
explanatory power for school input variable per se. The interaction, 
as a child progresses through school, between socioeconomic characteristics 
of his home and socioeconimic characteristics of his school environment 
is a process relating to his achievement. Isolating the precise nature 
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and estimating the iniportance of this relationship is not easy. 

Another exan5)le is that variations j.n per pupil expenditures within 
states are limited to a narrow range. A California study found that 
districts in that state tended to adjust local effort to approach the 
state average overtime, regardless of migration, fund sources or other 
localized change.^ Many states have state programs whose purpose is 
to equalize per pupil expenditures among their school districts. Hence, 
efforts to aggregate effects of spending on achievement are thwarted 
by the fiscal trends within states and by the way in which data is 
collected. Longitudinal studies to date have the advantage of following 
students through time rather than using cross-sectioned, surrogate 
measures of causation and change. They have related only to limited 
groups (i.e,, a few states or cities) or single projects. 

A striking characteristic of Congressional testimony given prior 
to the passage of Elementary and Secondary Education Act in 1965 is 
its lack of quantitative estimates of which, among a multitude of 
variables, are those which yield highest productivity in terms of 
achievement differentials. A survey of research funded by the Office 
of Education and catalogued in Educational Resources Information 



^ Gorfinkel, Maury H., et al., Cost-Benefit Model to Evaluate Educa- 
tional Programs (Prepared for NCES, Contract OEC 4-7-000010-0010) , 
Menlo Park, California: Stanford Research Institute, April, 1967, 
pp. III-22. 

Spiegelman, R., et al.. Entitlements for Federally Affected School 
Districts Under Public Laws 874 and 815 . SRI (Monograph). Menlo 
Park, California; Stanford Research Institute, May, 1965, pp. 116-176. 
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Center, reveals that the greatest proportion of studies prior to 1965 
were designed to answer one or more of the following questions! 

1. How are poverty, cultural deprivation, and other such terras 
best defined? 

2. Ijhat behavioral and attitudinal patterns maximize the 
ability of middle-class adults to relate productively 
to learning styles of underachievers (or low-income 
youths) in a school setting? 

3. What behavioral norms characterize low-income under- 
achievers? "Good" achievers? 

4. How can predictive testing instruments be designed for 
culturally different student groups? 

5. How should compensatory education programs be evaluated? 

6. How can motivation of underachieving children be 
maximized? 

7. How can the school setting compensate for initial socio- 
economic differences of students? 

The emphasis in research on educational psychology and sociology as 
opposed to economics is exen 5 )lified by the fact thcit ERIC Indexes for 
1956-63 contain no category called "low income" and list no funded 
research projects under the category "economic." Social class 
differences are those which differentiate participants in compensatory 
education programs from nonparticipants. Those relatively few research 
projects before 1965 which dealt with economic featuies of educating 
low income youths make establishing baselines for Elementary and 
Secondary Education Act program evaluation difficult. A look at these 
pieces of research will reveal why. 
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RESEARCH ON DETERMINANTS OF ACHIEVEMENT. 

A flUMiary by the National Education Association of programs for ^ 
the disadvantaged in 1963 cited programs in 42 out of more than 26,000 
districts in the nation. These were pilot demonstrations in a few 
schools within these 42 districts The research funded by the Office 
of Education in this field prior to 1965 focused on many of these 
single district projects. In I960 an Office of Education publication- 
presented profiles of finance programs for 1957-58 which emphasized 
sources and distributions of funds by state ¥nile cost accounting 
data presented in this volume disclose foundation program and special 
purpose grant prograJm funds escpended by program type, only rough 
estimates of the level of fiscal effort devoted specifically to low- 
income youths are derivable. For example, the largest percentage of 
state funds were granted to districts in special purpose flat-grant 
distributions. Theoretically conducive to local initiation of educa- 
tional services to meet needs not specified in these grants, flat 
grants are complemented by equalization grants designed to raise 
support levels of financially weaker districts in the State. 

Vocational education and programs for physically handicapped and 
mentally retarded youths were the most common special purpose flat 

^ National Education Association, School Programs for the Disadvantaged, 
Circular No. 2, 1963, l^ashingtonr NEA- Educational Research Service, 
February, 1963. 

U 

Munse, Albeit R., McLoone, Eugene P., Public School Finance Programs 
of the U.S.. 1957-58 . OE 22002, No. 33, U. S. Department of Health, 
Educational and Welfare, I960. 
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grants relevant to the disadvantaged, as the chart on page 5a shows. 

Eligibility for participation in these programs does not include low-. 

income level in any state. The participation rates by income category 

are unavailable. Gross amounts of money expended for these purposes 

are included for 1957-58, but are of little help in estimating output 

per unit of input , which is the critical economic question. A complete 

definition of school output as measured by incremental achievement 

should include gains in academic achievement, social competence, 

citizenship and responsibility, judgment, self-confidence, and 

creativeness. A definition of efficiency for. a particular curriculum 

conponent is maximum increased achievement, measured on instruments 

valid for that curriculum component and student group, per unit of 

funds expended for that component. 

This definition, however, assumes that per pupil expenditures are 

the key determinant of pupil achievement. Studies both before and 

after 1965 refute this notion. Project Talent’s well-known finding 

that in some types of cities the relationship between achievement and 

expenditure per pupil (defined either in Average Daily Attendance or 

6 / 

A-verage Daily Membership terms)-' is hard to interpret since these 
effects are not adjusted for family background or school environment 



¥ 






The chart was assembled from separate state profiles in Albert R. 
Munse, Eugene P. McLoone, op. cit . 

A strong relation was found in: Cities over 1-J- million in population 
with generally low incomes. Northwestern cities with less than 250,000 
persons, low income Viestern cities with less than 250,000 persons. 
Southeastern cities with moderato income, and small Western towns, 
Pro.lect Talent One Year Follow-up Studies . University of Pittsburgh, 
School of Education, 1966. 
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factors discussed in the 1966 Educational Opportunity Survey.-^ It vas 
found that only a small percent of total achievement variations are 

• 

represented by achievement variations between schools ^ but it was also 
found that the inter-school differences that do exist are greater for 
Negro than white children. Minority children's performance is highly 
related to teacher and peer characteribbics, but related to per pupil 
expenditures only in the South at grades, 6, 9> &nd 12. The high de^ee 
of inter correlation among the variably inhibits the drawing of definitive 
conclusions regarding the unique impact of expenditure per pupil, 
teacher characteristics, peer attitudes and characteristics, or school . 
program. Controlling for family background weakens the effect of 
school expenditures since family characteristics are related to 
expenditure in motivational and fiscal capacity terms. Project Talent 
researchers found that school variables explain more of achievement 
variance if students are . classed according to the size and predominant 
socioeconomic level of their city and school district. Pupils of low 
socioeconomic status in highest expenditure local districts performed 
at much lower achievement levels than high socioeconomic status youths 
in lowest expenditure districts. It is not established from Project 
Talent whether large increments in expenditures are more, less .or 
equally efficient when conpared to relatively small dosesl'^ 

^ Coleman, James S., Ernef.vt Q. Campbell, Carol J. Hobson, James 
McPartland, Alexander M. Mood, Frederic Ne inf eld, Robert L. York, 
Equality of Educational Opportunity, Washington, D C.: OE-38001, 
1966, pp. 310-*^25, U.S* Department of Health, Education and Welfare. 

8 / 

■ Project Talent One Year Follow Up Studies , op. cit. 
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The body of research, less conprehensive than these studies, vhich 

indicates that per pupil expenditure increases do not account for major 

9/ 

achievement incx eases as much as do other factors, is impressive. 

Yet, Herbert Riesling's study of New York's districts concluded that 
in districts with over 2,000 pupils additional expenditures of t-80 per 
pupil were associated with an additional month of achievement measured 
by achievement test scores.^ For small districts, increased expendi- 
tures were not related to measured achievement gains • A quadratic 
function fitting Riesling's data indicates that through low ranges of 
expenditure categories, test scores rose with incremental expenditure 
increases . Test scores fell at highest expenditure ranges . One cannot 
conclude that for low income youths the $80 - one month relation is 
valid, since it is aggregative across socioeconomic classes. The 
conclusion that higher returns are to be expected from expenditiires , 
ceteris paribus . in districts now spending relatively less per pupil is 
warranted . 



2/ Burkhead, Jesse, Fox, Thomas G., and Holland, John W., Input and 
Output in Large City High Schools . Sjyracuse; Syracuse University 
Press, 1967. 

Crandall, James H., A Study of Academic Achievement and Expenditures 
for Instruction . Ed. D. dissertation. University of California, 
Berkeley, 1961. 

Ross, Donald H., et al. Administration for Adaptability . Vols. I-IV, 
New York; Columbia University, 1951. 

^ Riesling, Herbert, Measuring a Local Government Service . A Study of 
Efficiency of School Districts in New York State . Ph. D. dissertation. 
Economics Department, Cambridge, Massachusetts: Harvard University, 
September, 1965. 
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Teacher quality was found to explain achievement changes best for 
low income children in California.^ Expenditures were inter-related 
however, since teacher quality was defined in terms of certification 
and salary. In other studies showing high correlations between ex- 
penditures and quality (defined as achievement gains or adaptability 
to changing conditions), quality measures are related to e:q)enditures . 

The problem of separating expenditures from teacher quality and 
from peer-home-community characteristics is foreboding. An interesting 
cross-section study tried to hold certain home and community effects 
constant to test the hypothesis that if factors of educational demand 
and ability to pay are held constant among districts , the variation 
in organizational structure for financing education will explain 
e 3 q)enditure variations Sampling 107 of the 119 largest school 
districts in the United States in I960, and including districts in 
36 states, the study confirmed the hypothesis. The basic structure 
of budget and expenditure decisions in most big cities assumes 
continuance of existing programs. Smaller cities are more likely to 
to make budget decisions at the margin on a program basis. Large city 

California State, "State and Local Fiscal Relationships in Public 

Education in California," Report of the Senate Fact-Finding ' 



12 / 



ly 



Cnnitn-! ttee on Revenue and Taxation . Sacramento, March, 1965. 

Mort, Paul R., Reusser, Walter C., and Polley, John W. , Public 
School Finance. New York: McGraw-Hill, I960, chapter 5. 

James H. Thomas, Kelly, James A., and Gorms, Walter I., Deter s 
minants of Educational Expenditures in Large Cities of the U.S. . 
Cooperative Research Project 2389, U.S.O.E., Stanford University 
School of Education, 1966. 
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budget-makers for schools focus on proposed additions to their program, 
rather than on the basic program itself. E:qpenditure variations for 
basic program changes are explained by the degree of centralization in 
the budget-making process in large city school districts. The use of 
distributional formulas for determining fund levels needed for 
particular budget categories encourages centralization in the budget- 
making process. It neutralizes many professionals with program 
eiqpertise from participation in the process. The greater the degree 
of centralization, the lower the tendency for expenditures to vary 
from past program levels. This study concluded that the much-discussed 
dichotomy of fiscal independence versus dependence is unrelated to 
educational ejipenditure level or mix. The form of governmental 
arrangements has consequence for school e:q)enditures insofar as it 
determines the dynamics of budget decision-making processes. Another 
finding that the higher the unen5)loyment rate in a district, the 
higher the per pupil expenditure level may reflect lags in governmental 
response to economic change. This study concluded, tentatively, that 
the general price level in a state may determine expenditure levels. 

The highest percentage of variance in e 3 q)enditure level was e3q>lained 
when three classes of variables were included; ability-demand, 
governmental, and price level variables. The categorization of ability- 
demand variables, confirmed as valid by the researchers, enabled them 
to hold demand for education constant. Variables describing fiscal 
capacity or ability of cities studied are distinguished from those 
indicating demand for education. 




The ability-demand schema and conclusions based upon it provide no 
better ability to control for the three factors (per pupil expenditiire , 
teacher quality, home-peer-comraunity characteristics) cited above than 
previous research efforts yielded. 

One piece of work which attenpted to separate these factors, prior 
to the Educational Opportunities Survey, was funded by the Office of 
Educa-Dion and coD 5 )leted in 1963.^ Setting out to identify every 
obtainable item of data with any apparent relation to educational 
finance, this study of 104 Wisconsin school districts and of 3 other 
states began with l6l variables reflecting economic and social 
characteristics of local districts. Intercorrelation con 5 )utations 
reduced the number of variables to 70 correlates of expenditure 
per pupil. Following the earlier work of Shapiro, using 1920-40 and 
50 data with I960 census data, the objective was to isolate the socio- 
economic determinants of educational e3q)enditure and to estimate their 
relative inportance. Of the 70 variables remaining, 26 related to 
ability to support education and 44 related to need for services. 

These were clustered into twelve ability factors and eight needs 

■ 15/ 

factors and subjected to discriminant analysis.—^ This showed that: 



Peterson, LeRoy, Rossmiller, Richard A,, North, Stewart and Wake 
field, Howard, Economic Impact of State Support Models on Educa - 
tional Finance . Cooperative Research Project No. 1495, U.S.O.E,, 
University of Wisconsin, School of Education, 1963. 

Ibid., chapter VIII. 



1. No single measure of wealth currently in use describes 
fiscal capacity for education adequately, but personal 
income tax paid is the most suitable available* 

2* Relative wealth of local community is unrelated to 
municipal school support and to population size. 

3* Dropouts vary positively with percentage of teachers 
with less than 4 years of professional preparation and 
negatively with mean teacher salary • No correlation 
was found between dropout and ability^ of student body , 
class sizes or course of study distributions. 

4* State-support programs have equalized educational 
opportunities but (a) education has been isolated 
from other local services; (b) fiscal capacity 
measures are not accurate estimates or predicators 
of the substance and quality of education which a 
locality will offer. 

While this study would lead one to conclude that increased eaq)endi- 
tures (on teacher salaries) will reduce dropout rates, it says nothing 
about achievement increases as causally related to increased eaq)endi- 
tures. While the incremental achievement growth rates of increased 
expenditures in Higher Horizons Programs in New York City (and in 
the Demonstration Guidance Program preceding Higher Horizons) were 
fairly large in reading comprehension, they were negligible in 
arithmetic reasoning. No definitive conclusions about the outputs 
derivable per unit of increased per pupil expenditure can be made 
from the Higher Horizons experiment. The first-year Title I 
Elementary and Secondary Education Act e 3 q)enditure level for New York 
City alone was 5-6 times the Higher Horizon level. It may well be 
that expenditures were not raised enough or that they were not 
utilized on the optimum service mix to yield significant achievement 
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results.-^ The St. Louis study of droput prevention via increased per 

pupil e^enditures showed large retention rate increases hut no 

. 17/ 

significant achievement level increments. 

A reasonable conclusion seems to be that only slow and small 
increases in achievement should be expected per unit of e: 5 >enditure 
increase. Rather than massive spending increases per se, increases 
in appropriate combination of services yield greater achievement 
pay-offs. Gordon's recent survey of con 5 )ensatory education inclusive 
of federally supported programs concludes, however, that the appropriate 
mix of services for any given low-income group is unknown. The fact 
is that less instructional time has gone to the low-income child due 
to higher absenteeism and larger percentages of class time spent on 
discipline. Flexible scheduling and collateral services to combat 

19/ 

these factors are part of the "best mix" idea.-^ 

The discontinuity of research prior to 1965 characterizes more 
recent research as well. Some strains of evolution toward greater 



W Wrightstone, J.W., et al.. Evaluation of the Higher Horizons Pro- 
gram for Underprivileged Children," Cooperative Research Project 
No. 1125, U.S.O.E., Board of Education of the City of New York,1964. 

The School and Community Work Related Education Program ; A Ford 
Foundation Project, Activity and Progress Report, 1961-62, Shaw 
School, St. Louis, 1962. 

1 ^ 

Gordon, Edmund and Wilkerson, Doxey, Compensatory Education for 
the Disadvantaged : Programs and Practices ; Preschool Through 
College, College Entrance Examination Board, New York, 1966. 

12 / 

Clowad, Richard and Jones, James, Social Class: Educational 
Attitudes and Participation , New York: Columbia School of Social 
Work, Columbia University, 1962. 
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coimmmality of approach are detectable, providing grounds for believing 
that a conprehensive theory of the input-output behavior of educational 
systems is forthcoming. A look at results of major recent studies 
prefaces the articulation of conclusions about the most valid theoretical 
propositions which one can make about (1) the determinants of incre- 
ments in measured achievement; (2) the relative inportance of increases 
in per pupil expenditures on achievement increments; (3) the specific 
school characteristics which most directly affect achievement gains; 

(4) the iii 5 >lications of these findings for low-income students; and 

(5) . work toward integration of these factors.' Eric Thornblad studied 
public housing students in Chicago residing in three four-square mile 
areas with concentrations of high, middle and low-income families 
respectively. His objective was to determine whether there were 
maldistributions of funds e3q)ended for low-income relative to other 
income group students. Thornblad found absolute differences between 
e:q)enditures in only two regards: teacher salary expenditures and 
maintenance of school buildings. He’ found that administrative 
e 3 q>enditures were equally distributed among areas of different income 
levels. The policy of a voluntary transfer rather than required 
continuance of teachers in originally assigned schools enables teachers 
to transfer from low-to-high-income schools. More experienced teachers 
with correspondingly high salary expenditures were in middle and upper 
income schools within the city of Chicagq explaining 50 percent of • 
gross expenditure differences. The remaining half of spending dif- 
ferences were e:q>lained by the fact that, public housing concentraticns 
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of low-income youths forced the construction of newer and larger school 

plants. These plants, Thornblad found, required lower unit maintenance 

costs than buildings. 10-12 years older in higher income areas . He 

found no significant expenditure discrimination regarding instructional 

supplies. The rationale for policies allowing e^erienced teachers to 

transfer within the inner-city district to middle from lower income 

schools is that experienced teachers might be lost to suburban districts 

if transfer requests were disregarded. Thornblad »s conclusion is that 

prior to Federal aid for low-income youths there was no e3q>enditure 

discrimination against low-income youths. He found, in fact, a greater 

concentration of school construction in low-income areas, but this was 

counteracted by higher maintenance costs for buildings in higher-income 

areas. Pupil/teacher ratios were not uniformly different between low 

and other income class students. Although he didn't control for quality 

of school plants, his impression was that significant qualitative 

differences were nonexistent.*^^ He did not test for relations between 

21 / 

expenditures and achievement. — ' 



2 ^ 



Thornblad, Eric, Fiscal Impact of High Concentration of Low Income 
•Fflin-i 1 -I Pfl Upon the Public Schools . Ph.D. dissertation. Department 
of Education, University of Illinois, 1966. Also telephone con- 
versation by the author with Mr. Thornblad, July, 1967. 

For a study using a similar technique on primary schools with 
surprisingly similar fiscal conclusions, see Katzman, Martin, 
Distribution and Production in Big City Elementary School Systems , 
Ph.D. dissertation. Economics Department, Yale University, 1967. 
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Shaycoft's recent analysis of Project Talent data, using a variety 
of statistical techniques, is inconclusive about the growth of cognitive 
skills in secondary school as related to expenditui'JS per pupil. No 
expenditure data is included, so it is of no help in assessing whether 
or how much a given expenditure increase may affect achievement. The 
precise set of school characteristics which relate to school achieve- 
ment differences after initial student ability and socioeconomic 
status are controlled cannot be extracted unambiguously from the data. 

Many «» aptitude” measures, for example, were highly correlated with the 
amount of course work taken in certain subjects. Some evidence indicates 
that reading con^jetence fails to increase for vocational students of 
conparable aptitude as much as it does for college preparatory students 

in high school. .If further research is conclusive on this point, a 

22 / 

revision of vocational curricula may be indicated. The point is 
that no hard conclusions can be made regarding affectors of achievement 
gains in students from this study. 

The Educational Opportunity Survey, •^designed to see how well 
achievement is explained by factors traditionally considered good 
measures of school quality, included as variables per pupil expenditure 
per school system, class size, teacher experience and training, curricula, 
facility quality, collateral school services (e.g., counseling, health, 
arts, athletics, etc.), and student body characteristics. These dependent 

^ Shaycoft, Marion F., Project Talent: The High School Years : Growth 
in Cognitive Skills . Pittsburgh: School of Education, University 
of Pittsburgh, 1967. 

Coleman, James S., et al., pp. cit . 




variables were related to achievement as measured on three types of 
instruments: (l) basic skills (reading comprehension and mathematics ^ 
ability) j (2) general information^ (3) verbal and non-verbal ability 
tests Analyses of the relation between dependent variables and the 
achievement factor were done using samples of 1,000 students for grades 
1, 3, 6, 9 and 12. Eight geographical strata (five metropolitan and 
three nonmetropolitan) for Negro and white pupils and four ethnic 
strata not disaggregatable geographically (Mexican, American Indian, 
Oriental, and Puerto Rican) conposed the final working tape. Multiple 
partial regressions to which independent varia.bles of special interest 
were added yielded the unique-variance accounted for by each special 
independent variable. The unique-variance contribution of the student 
body quality variable is higher for ethnic and racial minorities than 
for the white majority. Thus the study concluded that peer group attri- 
butes esplain more achievement variation among minority group youths 
than school facility or staff attributes. This does not mean, however, 
that school characteristics are unimportant. A set of three attitudinal 
indices accoui-ted for more achievement variance than any other set of 
variables included in the study . These indices were : 

^ Study of these tests using factor analysis revealed that a five- 
component factor provided the best index of achievement. Weights 
for components of the achievement factor were: Non-verbal Ability 
.76, Verbal Ability .92, Reading Conprehension .87, Mathematics 
Achievement .85, General Information .91. See Mayeske, George W., 
Weinfeld, Frederic D., Factor Analyses of Achievement Measures 
From the Educational Onnortunities Survey . Technical Note No, 21, 
Division of Operations Aiialysis, National Center for Educational 
Statistics, Office of Education, Department of Health, Education 
and Welfare, January 18, 1967. 
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1. Student interest in school and reading outside school; 

2. Student self-concept as related to school success; and 

3. Student sense of control over his own self-destiny. 

The in?)lication is that schools have great in^ortance in that they affect 
these attitudes. The influence of school facilities, curriculum and 
staff that is independent of family background is small yet teacher 
characteristics, after family background influence has been controlled, 
explain most of the differences in school factors which are related to 
achievement. The strong association of family background with achieve- 
ment does not diminish as children grow older Schools interact with 
peer and home factors to affect attitudes which in turn affect achieve- 
ment. Future studies in the Division of Operations Analysis using this 
survey data will provide additional insights into the relative strengths 
of those independent variables most strongly affecting achievement. 

The Most Effective Schools' program in 21 New York City schools, 
expending ^859 per pupil in 1964-65 exceeded regular school expenditures 
by $425 per pupil. This magnitude of e:q)enditure increase yielded 
reading ability scores of student recipients at or above the national 
norm. Though the program reaches only five percent of the city's slum 
students, program experience to date does indicate that enough expendi- 
ture increase is associated with achievement gains. Not only were 

^ Mayeske, George W., Educational Achievement Amo ng Mexican-Americans 
A Special Report From the Educational Opportunitie s Survey. 
Technical Note Number 22, Division of Operations Analysis, National 
Center for Educational Statistics, Office of Education, Department, 
of Health, Education and Welfare, February 1, 1967, p.9. 
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class sizes reduced in these 21 schools, a host of nev services were 
offered to integrate the students' home, community and social life ^ 
«ith his school life. Hence the "best mix" of services, rather than 

funds per se, explain achievement gains. 

The quality assessment battery devised by Educational Testing 
Service for Pennsylvania Board of Education was administered in that 
state to establish input-output norms against which Pennsylvania 
schools might evaluate themselves.^ The need to incorporate into 
such evaluations a variable of test-taking motivation is clear. 
Extrinsic rewards promised to low-income students yielded effort 
sufficient to produce significant increases in achievement scores. 
Middle and upper-income students did not expend increased effort. They 
are reported to try hard on tests whether or not extrinsic rewards are 
offered.^^ The results of Educational Testing Service efforts in 
the development and administration of this test battery offers promise 
for input-output evaluations of educational efficiency. It is conpre- 
hensive in the range of qualitative changes it measures. 



^ Educational Testing Service, A Plan for Ev^uating the 

Education Programs in Pennsylvania , vols. I-III, A report from ETS 

to the State Board of Education, June- 30, 1965. 

^ Ibid . . vol. I, p. 87. 

^ Ten output measures (Goal Attainment Indices) , having been ranked 
for reliability, validity, and homogeneity are measures of self- 
under standing, tolerance, basic skills, attitude tow^d school, 
citizenship, health, creativity, vocational preparation, intellectual 
achievement and preparation for change. In some of these categories 
instruments are insufficiently reliable but are being revised. 
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The question of whether responses on paper and pencil or verbal tests 
typify behavior is one which ETS will e3q)lore in on-going research. 

A schema, using 70 criteria for output evaluations for each school of 
each type, makes the battery comprehensive and flexible. One finding 
from the pilot use of this battery was that mean scores of the sanple 
in which each student was tesced twice were consistently higher than 
for those tested only once.^^ This suggests that the best input-out- 
put evaluations will come from those schools where testing is conpre- 
hensive and frequent. Unfortunately, testing procedures differ across 
districts so much that this is almost inpossible to find. Research 
properly disaggregated is directed more productively to places where 
achievement data is best. Properly disaggregated research might use 
the school district as the unit of analysis but should facilitate 
inter-school conparisons . Educational Testing Service found that 
inter-school conparisons varied widely depending on whether schools 
are judged according to gains adjusted for differences in the 
scholastic ability of students.*^ Where the latter approach was used, 
many schools were equal whereas with the former approach, major output 
(differences seemed to exist. Ideally the latter should be used for 
economic analysis. The data for such computations is not easy to 
acquire, indicating another constraint on selection of research locales. 



IMd., vol. II, p. 21. 
Ibid., vol. II, p. 26. 
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The Educational Testing Service summary of school and community 
influences affecting achievement and aptitude scores, as reported in 
the literature, corroborates the contention that despite recent signs 

31/ 

of research integration, discontinuities and ambiguities still exist. 
Only one surveyed study found e ‘Urect relationship between per pupil 
expenditure as such and achie\ 3nt change.^ Most studies have not 
defined per pupil expenditure so that it is independent of other quality 
variables (e.g., teacher's salary). The six variables directly re- 
lating to achievement gains in two or more of the studies surveyed are: 
male teacher starting salaries, average number of years of teaching 

experience, number of books in the school library.’-, average class size, 

33/ 

pupil/teacher ratio', and percent of graduates going to college. 

The first five of these variables compose part of per pupil expenditure. 
If indeed these or some other set of per pupil expenditure con?)onents 
affect achievement, an hypothesis worth testing would be that achieve- 
ment-affecting components of per pupil expenditui/e explain more of the 
variance in actual per pupil expenditures than its components NOT 
related to achievement. Preparation and experience determine the salary 
for which a teacher qualifies. Hence teacher quality as measured by 
preparation, experience, and/or salary becomes a component of expendi- 
ture. To the extent that quality of school plant depends on cost of 
plant, facility quality becomes a component of expenditure. If one 
finds, for example, that teacher quality significantly correlates with 

^ Ibid. , vol. m, pp. 369 - 374 . 

Kiesling, Herbert, op. pit. 

^ Ibid., p. 371. 
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pupil achievement, while facility quality does not, one might ask which 
variable has greater power in eaqplaining how much money is spent for ^ 
education. Expenditures not strongly related to pupil achievement might 
dominate total expenditure patterns in a given school district. Policy 
changes might follow if decision-makers seek to maximize student 
achievement through the level and distribution of funds. 

A promising format for economic analysis of input-output relations, 
appears in a study recently con^leted by Jesse Burkhead and his 
colleagues Although Burkhead reports the data problems to be acute, 
the two years spent in Atlanta and Chicago by this team yielded high 
analytic pay-off. Grouping variables into input, status, process, and 
output categories, the study’s chief constraint is a universal one. 

That is, economists cannot resolve issues in learning theory on the 
relative values to be attached to educational outputs. One such issue 
revolves around the question of whether a distinctly separate sub- 
culture exists among low- income groups , the children in which are 

called ’’culturally deprived.” One theory, of which Frank Riessman is 

35/ 

chief e^qponent, holds that such sub-cultures exist.— Children from 

Burkhead, Jesse, Fox, Thomas G., and Holland, John W. , op. cit . 

Riessman, Frank, The Culturally Deprived Child . New York: 

Harper & Row, 1962. Also see Riessman, Frank, ’’Teachers of the 
Poor: A Five Point Plan,” in Urban Education and Cultural Depri - 
vation . Ed. C. W. Hunnicutt, Syracuse: Syracuse University, 

School of Education, 1964, pp. 15-31. 
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these sub-cultures have learning styles distinctly different from 

children who are part of the dominant cultures, Samuel Shepard 

exeD 5 )lifies the opposing theory and contends that the learning style 

of "culturally disadvantaged" children is not basically different from 

the style exhibited by other youths 

The format used by Burkhead for large city cross-section studies 

is not used with facility on small community high schools. Inputs 

measured in terms of socioeconomic backgrounds of students by census 

tracts are too aggregative since in small communities much hetorgeneity 

of family incomes within each attendance area exists. Comparability 

of data for small communities requires a student-by-student survey. 

Since the Burkhead model is static, parameters indicative of the 

structure of the urban econon^ are not conducive to educational demand 

predictions implying specific curricular changes. His surrogates for 

demands placed on schools by the urban econon^r are status measures of 

family income, a composite index of houaing quality, social and 

educational characteristics of the population, income distribution of 

student population, and strength of private school enrollment by income 

category. Growth patterns of sectors of the urban econoDQr, in addition 

to these status measures, place demands on schools for curriculum change, 

Shepard, Samuel, "Working With Parents of Disadvantaged Children," 
Urban Education and Cultural Deprivation , op . cit . . pp, 33-50. 

For further coiq)arisons of these points of view, see Jerome S, 

Bruner, Toward A Theory of Instruction . Cambridge: Belknap Press, 
1966, and John Holt, "A Little Learning," The New York Review . 

April 14, 1966 , pp, 8. 
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Dynamic models could account for these forces. The conclusion of 
Burkhead's study of Atlanta and Chicago is that socio-economic factors, 



not expenditures per se, almost wholly determine school outputs. The 

37/ 

most important in-school Variables center on teacher characteristics. 

The conclusions represent a unifying thread in research in this field. 

Current educational systems modeling promises to integrate the 
manpower demand-oriented approach with the earlier educational supply 
approach.^^ Manpower models isolate demand for labor by occupational 
or skill category and translate projected labor demanded into demand 
for education. Project METE, A Study of Manpower, Education, Training 
and Employment in the National Center for Educational Statistics, is 



using industrial fiTnployment projections in Standard Metropolitan 

39/ 

Statistical Areas to generate Occupation/Education coefficients.^ 
When multiplied by projected industry employment and summed across 
SMSA’s, these coefficients yield projected educational demand by type 
of education. Forthcoming applications of this technique will relate 



Burkhead, Jesse, op. cit., p. 75. 

See, e.g., early supply models exven 5 )lied in: Tinberger, Jan, 
"Quantitative Adaptation of Education to Accelerated Growth" in 
Herbert Parnes (Ed.) Planning Education for Economic and Social 
Development . Paris: OECD 1962. 

UNESCO, "Perspective of Educational Development in Asia: A Draft 
Asian Model,” Conference of Ministers of Education and Ministers 
Responsible for Economic Planning of Member States in Asia, 

Bangkok, November 22-29, 1965. 

Griest, Jeanne and Morsch, William C., Occupation Education Require - 
ments Analysis . Technical Note No. 37,’ National Center for Educa- 
tional Statistics, Division of Operations Analysis, Office of 
Education, Department of Health, Education and Welfare, May 16, 1967. 
This note applies to vocational education only. 
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many types of education to more disaggregated industrial breakdown of 
the economy. Another plan of attack on the demand side of educational 
modeling focuses on demography. Work is under way to model student- 
teacher population growth.-^ A national aggregative model, DYNAMOD II, 
represents the educational population and yields to analysis of effects 
of changes in birth and death rates. Some initial work with DYJIAMOB 
showed that changes in student retention rates had greatest impact 
in the college sector of the education system. However, the teaching 
sector was more sensitive than the student sector to changed retention 
rates. The analysis produced the conclusion that where student-teacher 
ratios are too high but student population growth is expected, the 
ratio is controlled best by increasing teacher retention rates first. 
These conclusions may interest inner city educators whose schools 
receive increasing numbers of in-migrants with low achievement levels. 
Teachers in schools servicing low-income populations exhibit high 
turnover rates. Their students exhibit high dropout rates. Educators 
trying to keep student-teacher ratios from rising as in-migration occurs 
can achieve quickest success by first adopting policies to retain 
their existing faculties and reduce turnover among new staff. Subse- 
quently, policies to increase student retention rates are indicated. 

^ Okada, Tetsuo, Methods of Projecting Births . Technical Note No. 36, 
National Center for Educational Statistics, Division of Operations 
Analysis, Office of Education, Department of Health, Education and 
Welfare, May 31, 1967. 

Ai/ Hudman, John T., Okada, Tetsuo, Zabrowski, Edward K., Zinter, 

Judith R., Student-Teacher Population Groifbh Model : DYNAMOD II , 
Technical Note No. 34, Division of Operations Analysis, National 
Center for Educational Statistics, Office of Education, Department 
Health, Education and Welfare, May 29, 1967. 
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Supply-oriented modeling must specify the capacity of the educa- 
tional system to meet demands for goods and services which maximize 
achievement.^^ Alternative supply mixes whose desirability is 
dependent on projected levels and types of demand for education have 
trade-off values (i.e,, marginal rates of substitution) which vary 
depending on which con^Jonents of the educational population are 
involved. That is, such trade-offs between supply mixes depend on 
the iinit of effective demand used. A framework for cost estimation 
for alternative program mixes in large urban schools has been 
developed. A model which estimates space and staff requirements, 
given the size of student population, is a second sub-model developed 
as part of the Urban Studies Project. Both supply-oriented, they will 
assist in evaluating educational part complexes in terms of achieve- 
ment increments.^ Studies of fiscal capacity and independence 
of local school districts also exemplify supply- oriented research. A 
recent study of six cities used three measures of school district 
innovation as dependent variables rather than achiiBvement. Using this 
measure of school output assumes that ’daptability of a school district 



^ For aggregate estimates of attainment in years of schooling terms 
and related concepts of educational capacity, see Wisler, Carl E., 
Methodolnpy for an Educational Attainment Model . Analytical Note 
No. 68, Division of Operations Analysis, National Center for 
Educational Statistics, Department of Health, Education and Welfare, 
September 5> 1967. 

O'Brien, Richard, Cost Model for Large Urban Schools . Technical 
Note Number 30 and. School Submodel for Urban Schools . Technical 
Note Number 38, Division of Operations Analysis, National inter 
for Educational Statistics, Department of Health, Education and 
and Welfare, April 26, 1967 and June 21, 1967, respectively. 



is its most inqportant characteristic.^^ Concluding that increased 
expenditures are a function of the level of innovation in a local 
district, the authors hold that innovation is the result only of strong 
community participation in school affairs plus the power to generate 
new programs and requisite fund raising. Political independence of 
a school board is not guaranteed by fiscal independence but by the 
board's capacity to develop power through community support. 



^ Gittell, Marilyn, Hollander, F. Edward, Vincent, William S. , 
Investigation of Fiscally Independent and Dependent School 
Districts . Cooperative Research Project No. 3237, U. S. Office 
of Education, Department of Health, Education and Welfare 
(Administered by City University Research Foundation, Columbia 
University, New York, New York) , 19^7 . 



CONCLUSIONS 



This r6S6arch survsy concludes thSL't the in^)orti&n'b (Question is not 
what determines e 3 q)enditures in schools; rather, what determines 
achievement increase and retention of students? Out-of-school factors 
are far more significant than in-school factors according to research 
results* Esiperience of the teacher seems to have major positive 
intact on reading scores and to be more important as an output 
determinant than class size or teacher formal education, for districts 
with relatively small ranges of variation in expenditures. In such 
districts school characteristics other than teacher quality seem 
relatively insignificant in output determination. Further research 
might focus profitably on conparisons of districts with large 
variations in variables of expenditure. 

A great need exists for educational experiments from which 
longitudinal data can be obtained. Researchers need to know, for 
exanple, not just whether a school has a library and how many books 
it has, but tire frequency of student use of library facilities over 
time. Intra-school conparisons with helpful educational policy 
implications require such data. 

We need better ways to understand and analyze the interactions 

between students and school staff, students and peers, and school 

and home. No quantitative analysis can capture the essence of such 

interpersonal interactions. Better understanding of those processes 

in education which are quantifiable will result from progress in 

quantitatively approximating the strength of these essentially intangible 
interactions . 
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